Video Semantic Segmentation With Distortion-Aware Feature Correction

نویسندگان

چکیده

Video semantic segmentation is active in recent years benefited from the great progress of image segmentation. For such a task, per-frame generally unacceptable practice due to high computation cost. To tackle this issue, many works use flow-based feature propagation reuse features previous frames. However, optical flow estimation inevitably suffers inaccuracy and then causes propagated distorted. In paper, we propose distortion-aware correction alleviate which improves video performance by correcting distorted features. be specific, firstly transfer distortion patterns into space conduct effective map prediction. Benefited guidance maps, proposed Feature Correction Module (FCM) rectify areas. Our method can significantly boost accuracy at low price. The extensive experimental results on Cityscapes CamVid show that our outperforms state-of-the-art methods.

برای دانلود باید عضویت طلایی داشته باشید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Video Scene Segmentation with a Semantic Similarity

Video Scene Segmentation is an important problem in computer vision as it helps in efficient storage, indexing and retrieval of videos. Significant amount of work has been done in this area in the form of shot segmentation techniques and they often give reasonably good results. However, shots are not of much importance for the semantic analysis of the videos. For semantic and meaningful analysi...

متن کامل

Nonlinear Distortion Correction in Endoscopic Video Images

Modern video-based endoscopes offer physicians a wide-angle field of view for minimally-invasive procedures. Unfortunately, inherent barrel distortion prevents accurate perception of range. This makes measurement and distance judgment difficult and causes difficulties in emerging applications, such as 3D medical-image registration. Such distortion also arises in other wide field-of-view camera ...

متن کامل

Low-Latency Video Semantic Segmentation

Recent years have seen remarkable progress in semantic segmentation. Yet, it remains a challenging task to apply segmentation techniques to video-based applications. Specifically, the high throughput of video streams, the sheer cost of running fully convolutional networks, together with the low-latency requirements in many real-world applications, e.g. autonomous driving, present a significant ...

متن کامل

Mobile Video Object Detection with Temporally-Aware Feature Maps

This paper introduces an online model for object detection in videos designed to run in real-time on lowpowered mobile and embedded devices. Our approach combines fast single-image object detection with convolutional long short term memory (LSTM) layers to create an interweaved recurrent-convolutional architecture. Additionally, we propose an efficient Bottleneck-LSTM layer that significantly r...

متن کامل

Variance-aware distortion estimation for wireless video communications

T i e problem of encoding and transmitting a video sequence over a wireless channel is considered. Our objective is to minimize the end-to-end didortimi while using a limited amount of transmission etierw and delay. In our approach. we jointly adapt thc source-codi~g parameters and transmission power per packet. We introduce the concept of “Variance-Aware Distortion Estimation” (VADE), and pres...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: IEEE Transactions on Circuits and Systems for Video Technology

سال: 2021

ISSN: ['1051-8215', '1558-2205']

DOI: https://doi.org/10.1109/tcsvt.2020.3037234